Vehicle software developer systems, methods and devices for vehicle software development

ABSTRACT

Vehicle developer devices, systems and methods are disclosed. In one embodiment, a vehicle developer device includes a plurality of electronic control units, a plurality peripheral devices communicatively coupled to the plurality of electronic control units, wherein one or more individual peripheral devices of the plurality of peripheral devices is a physical representation of an actual vehicle peripheral device, and a management computing device including one or more processors and a memory device storing computer-readable instructions. The vehicle developer device receives one or more sets of software instructions, compiles the one or more sets of software instructions for execution by at least one electronic control unit of the plurality of electronic control units, and receives output from one or more of: 1) at least one electronic control unit of the plurality of electronic control units and 2) at least one peripheral device of the plurality of peripheral devices.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority to U.S. Provisional PatentApplication No. 62/923,733 filed on Oct. 21, 2019 and entitled “Systemsand Methods for Vehicle Hardware and Software Development,” the contentof which is hereby incorporated by reference in its entirety.

BACKGROUND

Presently, software development is done by an automobile manufacturerusing test vehicles. However, third party applications that run on avehicle are becoming popular. Third party software developers do nothave access to test vehicles and must have their software tested by theautomobile manufacturer, which slows down the development process.Further, it may be beneficial for automobile manufacturer developers totest software on actual physical vehicle components without requiring atest vehicle.

Further, vehicle user interface (UI) designers use third-party graphicdesign tools to develop user interface screens. These tools areinsufficient and cause the design process for user interfaces to be tooslow. Vehicle user interfaces often have elements that interact with oneanother that the third-party tools do not address. For example,developers may not be able to test a particular animation when the ECUhas a particular error. The UI must be manually tested on a vehicle,which is costly and time consuming.

Accordingly, alternative systems, devices and methods for developingsoftware and user interfaces for vehicles may be desired.

SUMMARY

Embodiments of the present disclosure are directed to devices, systemsand methods that aid in the development of software and hardware fordeployment in vehicles.

The requirement of test vehicles to develop new software, hardware, anduser interfaces significantly slows down the design process, and alsopresents significant costs to automobile manufacturers, suppliers andthird party developers.

Embodiments of the present disclosure provide developer devices, systemsand methods that enable rapid software, user interface, and hardwaredevelopment that eliminate the need for test vehicles. Rather, software,user interfaces, and hardware may be developed and tested using scalemodel developer devices.

In one embodiment, a vehicle developer device includes a plurality ofelectronic control units, a plurality peripheral devices communicativelycoupled to the plurality of electronic control units, wherein one ormore individual peripheral devices of the plurality of peripheraldevices is a physical representation of an actual vehicle peripheraldevice, and a management computing device including one or moreprocessors and a memory device storing computer-readable instructions.The computer-readable instructions, when executed by the one or moreprocessors, causes the one or more processors to receive one or moresets of software instructions, compile the one or more sets of softwareinstructions for execution by at least one electronic control unit ofthe plurality of electronic control units, and receive output from oneor more of: 1) at least one electronic control unit of the plurality ofelectronic control units and 2) at least one peripheral device of theplurality of peripheral devices. The computer-readable instructionsfurther cause the one or more processors to provide informationregarding the output to one or more remote computing devices, whereinthe vehicle developer device simulates operation of a full-scalesimulated vehicle.

According to another embodiment, a method of developing a user interfaceincludes receiving, into a design user interface, one or more designassets, receiving, from the design user interface, one or moremanipulations of the one or more design assets to form a design projectcomprising at least one scene, providing software instructionsrepresenting the project to a vehicle developer device, and receivingevaluation information from the vehicle developer device, wherein theevaluation information is based at least in part on execution of thesoftware instructions by the vehicle developer device.

According to another embodiment, a vehicle software developer systemincludes a developer computing device, a vehicle developer device, andan electronic display device. The developer computing device isprogrammed to display a design user interface for receiving one or moredesign assets, receive one or more manipulations of the one or moredesign assets within the design user interface for generating one ormore manipulated design assets, and compile the one or more manipulateddesign assets into a design project. The vehicle developer device isprogrammed to receive the design project from the developer computingdevice, compile the design project into machine executable code, andexecute the machine executable code and produce a display output. Thevehicle developer device simulates operation of a full-scale simulatedvehicle. The electronic display device is programmed to receive anddisplay the display output from the vehicle developer device.

It is to be understood that both the foregoing general description andthe following detailed description present embodiments that are intendedto provide an overview or framework for understanding the nature andcharacter of the claims. The accompanying drawings are included toprovide a further understanding of the disclosure, and are incorporatedinto and constitute a part of this specification. The drawingsillustrate various embodiments and together with the description serveto explain the principles and operation.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 schematically illustrates an example vehicle user interfaceaccording to one or more embodiments described and illustrated herein;

FIG. 2 schematically illustrates an example design process workflowaccording to one or more embodiments described and illustrated herein;

FIG. 3 schematically illustrates an example vehicle developer systemaccording to one or more embodiments described and illustrated herein;

FIG. 4 schematically illustrates an example Home screen of an exampleuser interface (UI) design tool according to one or more embodimentsdescribed and illustrated herein;

FIG. 5 schematically illustrates another example Home screen of anexample UI design tool according to one or more embodiments describedand illustrated herein;

FIG. 6 schematically illustrates an example Project Overview screen ofan example UI design tool according to one or more embodiments describedand illustrated herein;

FIG. 7 schematically illustrates another example Project Overview screenof an example UI design tool according to one or more embodimentsdescribed and illustrated herein;

FIG. 8 schematically illustrates an example Design Workspace screen ofan example UI design tool according to one or more embodiments describedand illustrated herein;

FIG. 9 schematically illustrates another example Design Workspace screenof an example UI design tool according to one or more embodimentsdescribed and illustrated herein;

FIG. 10 schematically illustrates internal components of an examplevehicle developer device according to one or more embodiments describedand illustrated herein;

FIG. 11A schematically illustrates a developer computing device of anexample vehicle developer device according to one or more embodimentsdescribed and illustrated herein;

FIG. 11B schematically illustrates a management computing device of anexample vehicle developer device according to one or more embodimentsdescribed and illustrated herein;

FIG. 12 schematically illustrates peripheral devices according to one ormore embodiments described and illustrated herein;

FIG. 13 schematically illustrates an example vehicle developer deviceconfigured as a miniature vehicle according to one or more embodimentsdescribed and illustrated herein; and

FIG. 14 schematically illustrates another example vehicle developerdevice configured as a miniature vehicle according to one or moreembodiments described and illustrated herein.

DETAILED DESCRIPTION

Embodiments of the present disclosure are directed to vehicle developerdevices that provide for rapid development and testing of vehiclesoftware, including user interfaces that do not require an actualtesting vehicle. In one example, the vehicle developer devices andsystems described herein enable software developers to easily developand test software applications without requiring an actual vehicle totest their software.

Traditionally, vehicle software and hardware developers require afull-size test vehicle to rigorously test software code and/or hardware.The software and/or hardware is installed in the test vehicle, which isthen operated according to test parameters. Feedback is then gatheredregarding the performance of the software and/or hardware. However,developers, such as third party developers, may not have access to testvehicle and therefore may not be in a position to test software and/orhardware until much later in the development cycle. Further, testvehicles are large and expensive. Requiring a test vehicle is costly andslows down the development process.

Embodiments described herein provide a way for developers to easilyevaluate software and/or hardware on actual vehicle hardware withoutrequiring a full-scale test vehicle. As described in more detail below,the vehicle developer device is configured as a small vehicle developerdevice that has all necessary hardware components and connectors for oneor more real vehicle electronic control units (ECU) that are deployed ina particular vehicle. In some embodiments, the vehicle developer devicehas development and debugging tools installed and can be customizedusing user interface components. As one example, a version of thevehicle developer device may resemble a small version of a vehicle so itcan be placed on the ground and tested on a course (e.g., a miniatureroadway).

The vehicle developer devices described herein make it easier fordevelopers to write software for vehicles at least because developerswill not require a real vehicle to test code. In some embodiments, thevehicle developer device may abstract away various vehicle components sothe developer may focus on functionality that is of concern. As anon-limiting example, the vehicle developer device may include hardwarefeatures that represent features of the vehicles, such as LEDs thatrepresent tail lights, or small actuators that represent a brake pedalor a steering wheel. As stated above, the vehicle developer device maybe configured as a mini-vehicle that the software developer can writecode for and test. For example, the vehicle developer device may have amini CAN network that is able to actuate interior lights, exteriorlights, motors, etc. similar to a real car.

It is noted that the vehicle developer devices described herein are nota specific piece of hardware, but a set of specifications for supportedhardware with which related developer tools can offer tight, unifiedintegration and development workflows.

In addition to software such as applications, the vehicle developersystems, devices and methods described herein may include a userinterface (UI) developer engine that allows UI developers to nativelycreate, compile, and test vehicle UIs on the vehicle developer devicewithout requiring a test vehicle. UI design applications are complexpieces of software and require significant experience to useeffectively. Instead of creating another UI design application just forvehicles, which would require significant development startup costs anduser retraining costs, the vehicle developer systems described hereinact as a bridge between standard design tools and the vehicle.

A desired feature for UI development is to have the ability to rapidlyiterate over different designs to gather user feedback. Traditionalvehicle software deployment pipelines do not allow for rapid deploymentand iteration. However, the vehicle developer device allows for users torapidly build, deploy and test changes to real hardware. Designers andengineers may connect the vehicle developer device to their PCs tocreate, deploy, and interact with application changes quickly andeasily.

By way of the vehicle developer device, the UI developer engine hasaccess to sound, seat haptics, sensors, actuators and various HMIfeatures of the vehicle. Developers may use the UI developer engine todevelop vehicle user interfaces. The vehicle developer device allows UIdevelopers to test their designs in a simulated vehicle environmentusing the vehicle developer device. As an example, the vehicle developerdevice may include a tool that simulates error message to see how the UIunder test handles such error messages.

Accordingly, embodiments described herein enable vehicle developers,suppliers, and third parties to quickly iterate and deploy new softwareand hardware to a vehicle. The tools allow UI teams to test new ideasagainst real users quickly to create data driven, user centric designs.

The UI developer engine allows designers to create, deploy, and interactwith user interfaces quickly and easily. Generally, the UI developerengine includes a software design tool that allows users to importand/or create design assets that are manipulated to create scenes of auser interface.

A non-limiting example of a vehicle user interface 10 is shown inFIG. 1. The example vehicle user interface 10 includes a display 12 thatis located along a certain length of the dashboard. The vehicle userinterface 10 has various zones for displaying information, such as afirst zone 14 for displaying speedometer data and a second zone 16 fordisplaying environmental information and/or warnings. It should beunderstood that embodiments are not limited by the vehicle userinterface 10 of FIG. 1 and that any number of zones may be provided andany type of information may be displayed.

It should also be understood that vehicle user interfaces are notlimited to any one display screen, and may include many interiorcomponents, such as multiple displays (e.g., a dash board display asshown in FIG. 1, a heads-up display, a console display, light emittingdiode displays, haptic feedback devices, interior lighting, sound systemsettings, and the like. The overall vehicle user interface may bedefined by a plurality of scenes that are defined both by the user aswell as the current driving context of the vehicle. As described in moredetail below, one scene may be a user receiving a telephone call throughthe vehicle. The user may define settings of how such calls are to behandled, a designer may have defined the look and feel of the phone call(what is displayed on the screen, the sounds that are made) and how thevehicle peripheral devices (e.g., a cellular modem or a network devicethat receives a call) themselves transition the user interface betweenscenes. Thus, many aspects may dictate how a scene is presented to theuser by the user interface.

An example design process workflow using the UI developer engine of anexample vehicle developer device of the present disclosure isillustrated by FIG. 2. At block 50, one or more design tools are used tocreate graphics for a desired user interface. The one or more designtools include a proprietary design tool that is incorporated directlyinto the UI developer engine, or they may be third party design toolsthat are used to create UI assets that are imported into a UI designtool at block 52 (e.g., Adobe Photoshop® by Adobe of San Jose, Calif.,and Sketch by Sketch B. V. of Eindhoven, the Netherlands).

Design assets are graphical design elements that are arranged to form ascene of a user interface. Design assets may include logos, text,animations, illustrations, or any other imaginable graphical designelement. These design assets may be designed by third party tools atblock 50 and/or designed within the UI design tool at block 52.

The UI design tool allows the developer to manipulate and lay out howthe design assets will be arranged on one or more vehicle displays toform one or more UI scenes. The scenes can be edited with vehiclespecific information, such as the type of electronic display or otherdisplay device, the number of electronic displays or other displaydevice, and the like. The term scene is used herein to encompass athree-dimensional vehicle environment, where a designer or applicationcan actuate different devices throughout the environment, such aslights, sound, and electronic display devices.

The UI design tool also may compile the various scenes of a userinterface into a design project. Thus, the UI design tool assembles allof the scenes into one or more project files that represent the userinterface experience of the vehicle.

In some embodiments, the vehicle developer device includes a UIsimulator, which receives scenes at block 58 and simulates how scenesgenerated by the UI design tool will look and react in a vehicleenvironment. The UI simulator may run on the same computing device asthe UI design tool, or may run on a different computing device. At block60, in some embodiments, the UI simulator may simulate variousperipheral inputs and peripheral outputs, error messages, and sensordata to simulate an interaction with the scenes of the UI. For example,the UI simulator may simulate the vehicle receiving a phone call, one ormore doors being open, a potential accident, and any other number ofsituations a vehicle may encounter. Thus, UI simulator may emulate thevarious ECUs and peripheral devices of the simulated vehicle.

The UI defined by the scenes provided to the UI simulator may bedisplayed on an electronic display, such as a computer display monitor.In some embodiments, the simulated UI may be displayed on an actualvehicle display cluster that is communicatively coupled to the computingdevice running the UI simulation.

Feedback from the results of the simulation at block 60 in the form ofevaluation data may be provided back to the UI design tool. The feedbackmay be performance related using metrics, such as how quickly scenestransitioned between one another, if any errors were reported, if thesimulated UI affected simulated ECUs, if inputs using the simulated UIwere properly received by the simulated ECUs, etc. The feedback may alsobe subjective. For example, a designer may not like how certain designassets or scenes are displayed and may therefore make changes based onthe feedback using the UI design tool.

It should be understood that, although FIG. 2 illustrates a UIsimulator, in some embodiments there is no UI simulator provided.

Still referring to FIG. 2, the UI scenes of a project developed at block52 are provided to a vehicle developer device at block 54, where theyare compiled and executed for display on a display or a vehicle cluster.As described in more detail below, the vehicle developer device includesa management computing device that receives the UI project from thedesign tool, and compiles it into machine readable code that isexecutable by one or more ECUs of the vehicle developer device. Thus, adeveloper may quickly deploy UI code to the vehicle developer device forevaluation.

Interactions between the UI scenes of the project and the vehiclehardware of the vehicle developer device occur at block 56. As describedwithin respect to the UI simulator, inputs, outputs, error messages, andsensor data are used to see how the UI scenes perform at block 56. Forexample, the vehicle developer device may be manipulated to generateinputs to various sensors to prompt situations for the UI scenes. Asnon-limiting examples, a miniature door of the vehicle developer devicemay opened, a Bluetooth® signal may be provided to the vehicle developerdevice that indicates an incoming phone call, the vehicle developerdevice may be remotely driven on a course that includes other roadagents (e.g., vehicles) and situations to simulate actual driving totest various aspects of the UI scenes of the project. For example, thevehicle developer device may be driven or otherwise operated in a scaledenvironment that provides scaled buildings, roads, road agents (e.g.,vehicles, pedestrians, cyclists, and the like), signs, and trafficlights.

Further, error messages may be generated using the vehicle developerdevice (e.g., providing unexpected sensor data that generates one ormore errors) to see how the UI scenes react. Evaluation informationregarding the performance of the UI scenes are fed back to the UI designtool at block 52 where the design may make changes to the scene of theproject as described above with respect to the simulator. The evaluationinformation may include one or more errors, for example

An example setup for a vehicle developer system 90 is shown in FIG. 3.Generally, the system 90 comprises a developer computing device 101, avehicle developer device 100, and an electronic display 105.

The developer computing device 101 runs the UI design tool describedabove. In some embodiments, it may also include the UI simulatordescribed above with respect to FIG. 2. The developer computing device101 may be any type of computing device, such, without limitation, as adesktop, a laptop, a tablet, and the like. The developer computingdevice 101 is communicatively coupled to the vehicle developer device100 that includes one or more ECUs and provides a miniature version of avehicle. In some embodiments, the vehicle developer device 100 includesall ECUs, sensors, connectors and actuators of an actual vehicle so thata fully functioning miniature vehicle may be tested. In otherembodiments, vehicle ECUs that are not relevant are abstracted away andonly relevant ECU hardware is provided. In other words, some ECUs aresimulated by software code rather than providing physical ECUs. Thevehicle developer device 100 is communicatively coupled to theelectronic display device, which may be a computer display monitor, atelevision, or a vehicle cluster, for example. The electronic display105 displays the UI scenes as a display output that is outputted by thevehicle developer device 100.

Use of the UI design tool will now be described. A UI application for aparticular make and model of a vehicle is contained in a single project.The project is composed of multiple scenes with each scene comprising aplurality of design assets. Each scene represents a different vehicleapplication (e.g., a scene to handle incoming phone calls, or a scene todisplay maps/driving directions). Finally, each scene is composed ofmultiple device output layers (e.g., infotainment, instrument cluster,audio).

Different user interface screens of the UI design tool will now bedescribed. It should be understood that the screens described andillustrated herein are for illustrative purposes only, and do not limitthe embodiments described herein. The user interface screens may take onmany different configurations.

Referring now to FIG. 4, an example Home screen 200A of a design userinterface configured as a UI design tool is depicted. The Home screen200A may be a first screen that is shown when the application is opened.From the Home screen, a user can open a previous project or create a newproject.

In some embodiments, a navigation bar 230 is persistent in all screensof the UI design tool, and allows a user to navigate between screens. Asearch and user profile feature 232 is provided to enable a user tosearch for scenes or other information, as well as to view and setpreferences in a user profile. A Recently Opened section 234 displaysprojects that were recently opened by the user. As stated above, anindividual project may relate to an individual make and model of avehicle. Selection of a project opens a project file. A project filecontains files for all of UI assets associated with the project, and themetadata to restore the previous application state.

A New Project section 236 allows users to select prepopulated vehicleproject profiles, such as a custom vehicle model or a specific vehiclemake and model, for example. On selection, the user is prompted for alocation for which to create the project. This location is then filledwith the project files according to the selected template.

Another non-limiting example of a Home screen 200A′ that allows a userto create a new project or open a recent project is shown in FIG. 5. TheHome screen 200A′ illustrated in FIG. 5 shows more detail than the oneillustrated in FIG. 4. Similar to the Home screen 200A of FIG. 4, theHome screen 200A′ of FIG. 5 includes a search and user profile feature232′, a New Project button 236′ that allows a user to create a newproject, and a Recently Opened section 234′ that allows a user to openrecent projects. A Recently Opened preview pane 205 provides a previewof a recently opened project. One or more navigation features 235 allowa user to scroll through various previous of recently opened projects.

After creating a new project or selecting a recent project, the UIdesign tool is transitioned to the Project Overview screen 200B, anexample of which is shown in FIG. 6. From the Project Overview screen200B, the user may make project level adjustments and select a scene todesign or modify. A Scene Selection region 239 includes prepopulatedscenes or “moments” that are to be created for the selected vehicle. The“select scene” feature enables a user to select a particular scene towork on inside of the project. FIG. 6 shows non-limiting scenes of“Home.” “Handshake.” “Incoming Call,” and “Hazard Detect—Low level.” Anynumber of scenes may be included in a project. Profiles of users 138collaborating on the project may also be shown in some embodiments. Thedate/time of when each scene was last edited may also be displayed.

Another example of a Project Overview screen 200B′ is shown in FIG. 7.The Project Overview screen 200B′ provides a Scene Selection region 239′that provides a preview of each of the scenes. A user may select one ofthe scenes to edit and create that particular scene. An informationregion 240 may provide information regarding the scene, such as whichdisplay(s) the scene is intended for, version history, edit dates, andthe like.

Selection of a scene causes the UI design tool to transition to theDesign Workspace screen 200C, such as is shown in FIG. 8. From theDesign Workspace screen 200C, a user may import and edit design assetsand the data bound to these design assets (e.g., a design asset may be adigital speedometer having data representing speed bound thereto).

For example, design assets created in other design tools may be importedinto the Design Workspace screen 200C and manipulated. A user is able tomove assets inside the design (drag and drop), resize assets, and makeother edits. It should be understood that the Design Workspace screen200C is provided for illustrative purposes only, and that otherconfigurations are also possible.

A Navigation region 240 allows a user to navigate between variousworkspaces, such as, without limitation, a development environment, ananimation environment to provide animation tools, a file managementenvironment to find design assets, etc. Design assets may be placed inan Artboard region 246 and manipulated per the user's requirements.Thus, the Artboard region 146 provides a work area for the designer.

In the illustrated embodiment. Artboard tabs 242 enable a user to togglebetween the screens available in the particular vehicle. For example, atab may be dedicated to an individual electronic display (e.g., aheads-up display) and selection of the tab may enable selection ofscenes that are displayed by that particular electronic display. ALayers region 244 provides a smart grouping system for design assets.For example, certain design assets may be grouped together so that theycan be manipulated together. Tools for editing the scene are alsoprovided in a tools region 243. Any number of editing tools may beprovided, such as coloring, sizing, morphing, contrast, brightness, andthe like. Additionally, a timeline 250 including active layers tosequence may also be provided.

Accordingly, the Design Workspace screen 200C includes all of thefunctionality needed to design the scenes of the project. Anotherexample Design Workspace screen 200C′ is shown in FIG. 9. In the exampleof FIG. 9, the Design Workspace screen 200C′ has an Artboard region 246′for receiving and manipulating design assets. A Tools region 250provides tools for manipulating the design assets in the Artboard region246′, and a Layers region 251 allows a user to create different layersof the scene and to group various design assets together.

As described above, upon completion of the project design, the project,including all scenes, may be provided to the vehicle developer devicefor compiling and testing.

The vehicle developer device is a hardware component that operates as aminiature version of a full-scale vehicle, and includes ECUs andperipheral devices such as sensors and actuators of an actual vehiclethat is being evaluated. The vehicle developer device allows developersto quickly design and evaluate both hardware and software for vehicles.FIG. 10 schematically depicts an example vehicle developer device.

The vehicle developer device 100 is defined by a set of specificationsfor being connected to a developer computing device 101 (FIG. 3).Hardware built to these specifications can then integrate with othervehicle developer device tools (e.g., the UI design tool) to provide asmooth development workflow and allow designers and developers toquickly test applications and hardware on real vehicle hardware.

The example vehicle developer device 100 comprises three maincomponents: the management computing device 102, target ECU board(s)104-1-104-N (collectively “104”), and peripheral devices 106. Each ECUboard has one or more ECUs associated therewith. The managementcomputing device 102 is controlled via a network connection to adeveloper computing device 101. For example, the developer computingdevice 101 may be communicatively coupled to the management computingdevice 102 by a wired or wireless connection. The target ECU(s), whichmay include any number and type of ECUs, may be installed and connectedto the management computer by any method such as, without limitation,Ethernet.

The management computing device 102 is responsible for communicationbetween the developer computing device 101 and the ECU(s). Themanagement computing device 202 supports remote access andadministration over a network connection (e.g., Ethernet from thedeveloper computing device 101 to the management computing device 102).The management computing device 102 also supports tooling to supportremotely deploying (from the developer computing device 101) to aconnected ECU. From the developer computing device 101, a user is ableto run a command to deploy applications to the ECUs (e.g., by the UIdesign tool). Specifically, the management computing device 101 allowsthe deploying, running, and interacting with a running application on anECU of the vehicle developer device 200.

ECU board(s) (e.g., first board ECU 104A and second ECU board 104B) maybe connected to the management computing device 102 via Ethernet, andmay support any type of vehicle ECU. Non-limiting examples of ECUsinclude an engine control module, a powertrain control module, brakecontrol module, a central control module, a suspension control module, atransmission control module, a central timing module, a motor controlmodule, a general electronic control module, and an autonomous drivingmodule.

The ECU boards 104 may include sockets to easily insert and remove ECUsfor evaluation purposes. For example, when a new ECU is developed, anold ECU may be removed from an ECU board 104 and a new ECU inserted intothe sockets of the ECU board 104. Any number of ECU boards 104 may beprovided.

The vehicle developer device 100 further includes a communications bus107 that is the same as the communications bus on the vehicle that isbeing replicated. As a non-limiting example, the communications bus 107may be a CAN bus. The ECUs of the vehicle developer device 100communicate with one another on the communications bus 107.

The ECU board(s) support remote access and administration. For example,from a remote computing device (e.g., the developer computing device101), a user is able to access the ECUs (e.g., by secure socket shell orother network protocol) by way of the management computing device 102.For example, a user may interact with the management computing device102 and the ECUs by a simple command-line interface. Thus, a developeris able to interact with an ECU board 104 and its associated ECU forcommon debug steps.

The ECU board(s) 104 are also operable to run UI and other softwareapplications. Using the developer computing device 101, a user is ableto run applications on ECU(s) of one or more ECU boards 104 via themanagement computing device 102. For example, a user may instruct themanagement computing device 102 and the ECUs by a command-lineinterface.

As an example and not a limitation, command-line command(s) may be usedto perform the following: 1) compile a software application to run onthe vehicle developer device 100, 2) deploy the software application tothe vehicle developer device 100, and 3) start the execution of thesoftware application on the vehicle developer device 100. It should beunderstood that embodiments are not limited to a command-line interfacefor communication with the management computing device 102 of thevehicle developer device 100.

As a non-limiting example, the software application may be UI projectfile developed by the UI design tool described above. The user may sendthe UI project file to the management computing device 102, which thencompiles it into machine executable code for delivery and execution byone or more ECUs. For example, the machine executable code may be sentto the intended ECUs over the communications bus 107. As stated above,the UI code may then run on one or mom ECUs and other physical vehiclehardware so that the performance of the UI code may be evaluated. Theoutput of the vehicle developer device 100 may be provided on aconnected electronic display 105, such as a vehicle cluster (FIG. 3).

Software code other than UI code may be deployed to the ECUs of thevehicle developer device 100 using the management computing device 102.Vehicle ECU code (e.g., engine controller module code), device drivers(e.g., drivers for sensors and actuators), third party applications(e.g., a music streaming service, a video game, a video streamingservice, and the like), and the like may be provided to the managementcomputing device 102, which then compiles the software code (alsoreferred to as software modules) and deploys it to the proper ECU(s)and/or peripheral devices.

Thus, a developer is able to easily deploy and test software code onreal vehicle hardware without requiring a fully functional vehicle.

Referring now to FIG. 1A, a non-limiting example of a developercomputing device 101 for communicating with a vehicle developer deviceis schematically illustrated. While in some embodiments, the developercomputing device 101 may be configured as a general purpose computerwith the requisite hardware, software, and/or firmware, in someembodiments, the developer computing device 101 may be configured as aspecial purpose computer designed specifically for performing thefunctionality described herein. It should be understood that thesoftware, hardware, and/or firmware components depicted in FIG. 11A mayalso be provided in other computing devices external to the developercomputing device 101 (e.g., data storage devices, remote servercomputing devices, and the like).

As also illustrated in FIG. 11A, the developer computing device 101 (orother additional computing devices) may include a processor 166,input/output hardware 168, network interface hardware 170, a datastorage component 172, and a non-transitory memory component 160. Thememory component 160 may be configured as volatile and/or nonvolatilecomputer readable medium and, as such, may include random access memory(including SRAM, DRAM, and/or other types of random access memory),flash memory, registers, compact discs (CD), digital versatile discs(DVD), and/or other types of storage component. Additionally, the memorycomponent 110 may be configured to store operating logic 162A,communication logic 162B, and UX developer logic 162C (i.e., UIdeveloper tool logic)(each of which may be embodied as computer readableprogram code, firmware, or hardware, as an example). A local interface164 is also included in FIG. 11B and may be implemented as a bus orother interface to facilitate communication among the components of thedeveloper computing device 101.

The processor 166 may include any processing component configured toreceive and execute computer readable code instructions (such as fromthe data storage component 172 and/or memory component 160). Theinput/output hardware 168 may include an electronic display device,keyboard, mouse, printer, camera, microphone, sound emitting device(e.g. speaker), touch-screen, and/or other device for receiving,sending, and/or presenting data. The network interface hardware 170 mayinclude any wired or wireless networking hardware for communicating withthe management computing device 102, such as a modem, LAN port, wirelessfidelity (Wi-Fi) card, WiMax card mobile communications hardware, and/orother hardware for communicating with other networks and/or devices.

It should be understood that the data storage component 172 may residelocal to and/or remote from the developer computing device 101, and maybe configured to store one or more pieces of data for access by thedeveloper computing device 101 and/or other components. As illustratedin FIG. 11A, the data storage component 172 may include user interfacedata 174A relating to the UI design tool, which may include, withoutlimitation, design assets. Other data 174B to perform thefunctionalities described herein may also be stored in the data storagecomponent 172, which may include data for communicating with themanagement computing device 102 and other data for providing the UIdesign tool.

Included in the memory component 160 may be operating logic 112A (e.g.,an operating system for the developer computing device 101,communication logic 162B for communicating with the management computingdevice 102, and UX developer logic 162C for providing the UI designtool.

Referring now to FIG. 11B, a schematic illustration of components of anexample management computing device 102 is provided. While in someembodiments, the management computing device 102 may be configured as ageneral purpose computer with the requisite hardware, software, and/orfirmware, in some embodiments, the management computing device 102 maybe configured as a special purpose computer designed specifically forperforming the functionality described herein. It should be understoodthat the software, hardware, and/or firmware components depicted in FIG.11B may also be provided in other computing devices external to themanagement computing device 102 (e.g., data storage devices, remoteserver computing devices, and the like).

As also illustrated in FIG. 11B, the management computing device 102 (orother additional computing devices) may include a processor 114, networkinterface hardware 115, input/output hardware 116, a data storagecomponent 117, and a non-transitory memory component 110. The memorycomponent 110 may be configured as volatile and/or nonvolatile computerreadable medium and, as such, may include random access memory(including SRAM, DRAM, and/or other types of random access memory),flash memory, registers, compact discs (CD), digital versatile discs(DVD), and/or other types of storage components. Additionally, thememory component 110 may be configured to store operating logic 112A,ECU communication logic 112B, and ECU configuration logic 112C (each ofwhich may be embodied as computer readable program code, firmware, orhardware, as an example). A local interface 113 is also included in FIG.11B and may be implemented as a bus or other interface to facilitatecommunication among the components of the management computing device102.

The processor 114 may include any processing component configured toreceive and execute computer readable code instructions (such as fromthe data storage component 117 and/or memory component 110). Theinput/output hardware 116 may include an electronic display device,keyboard, mouse, printer, camera, microphone, speaker, touch-screen,and/or other device for receiving, sending, and/or presenting data. Thenetwork interface hardware 115 may include any wired or wirelessnetworking hardware for communicating with the developer computingdevice 101, such as a modem, LAN port, wireless fidelity (Wi-Fi) card,WiMax card, mobile communications hardware, and/or other hardware forcommunicating with other networks and/or devices.

It should be understood that the data storage component 117 may residelocal to and/or remote from the management computing device 102, and maybe configured to store one or more pieces of data for access by themanagement computing device 102 and/or other components. As illustratedin FIG. 11B, the data storage component 117 may include ECU data 118Arelating to a plurality of ECUs of the vehicle developer device 100.Similarly, configuration data 118B relevant to the ability for themanagement computing device 102 to configure the plurality of ECUs aswell as the peripheral devices of the vehicle developer device 100.Other data 118C to perform the functionalities described herein may alsobe stored in the data storage component 117.

Included in the memory component 110 may be operating logic 112A (e.g.,an operating system for the management computing device 102), the ECUcommunication logic 112B for communicating with the plurality of ECUs,and ECU configuration logic 112C for providing software code toconfigured the plurality of ECUs.

As stated herein above, the vehicle developer device 100 may beconfigured to have all hardware associated with an actual vehicle beingsimulated. Thus, the vehicle developer device 100 includes a pluralityof peripheral devices 106 that may be easily removed and added asneeded. As used herein. “peripheral devices” refers to any sensor oractuator of a vehicle. Sensors are devices that provide data back to oneor more ECUs, and actuators are components that perform a mechanicalmotion and/or an electrical response based on one or more instructionsignals from one or ECUs.

FIG. 12 illustrates a plurality of peripheral devices 106S configured assensors 106-1-106S-N and a plurality of peripheral devices 106Aconfigured as actuators 106A-1-106A-N. The sensors 10S6-1-106S-N may beany device capable of sensing the environment and providing acorresponding signal. Non-limiting sensors 106S-1-106S-N include lidar,radar, camera, proximity, contact switch, seatbelt, door, and passengersensors. The actuators 106A-1-106A-N may be any device capable ofreacting to an instruction signal. Non-limiting example actuators106A-1-106A-N include headlights, brake lights, interior lights, brakes,engine/motor, trunk release, horn, electronic display, climate controlcomponents, accelerator input, and the like.

The vehicle developer device 100 includes all peripheral devices 106 ofan actual vehicle or some subset of the peripheral devices 106 of theactual vehicle. The peripheral devices 106 may be connected to thevehicle developer device 100 by mating connectors and ports. Theperipheral devices 106 may be easily changed for testing and evaluation.

In some embodiments, the vehicle developer device 100 is a scaledversion (i.e., miniature) of a vehicle under evaluation. As non-limitingexamples, the vehicle developer device 100 may be 1:16, 1:8, 1:4 or 1:2scale of the vehicle under evaluation. Thus, in some embodiments, thevehicle developer device 100 may be operated on a table top for easyevaluation. FIG. 13 is an overhead view of any example vehicle developerdevice 300 that is a scaled version of an actual vehicle. In otherembodiments, the vehicle developer device 100 may not resemble an actualvehicle. In such embodiments, the vehicle developer device 100 may beconfigured as an evaluation board, for example.

Referring now to FIG. 14, a more detailed version of an example vehicledeveloper device 300′ configured as a vehicle is schematicallyillustrated. The vehicle developer device 300′ is capable of beingdriven and, in some cases, capable of autonomously driving if anautonomous ECU is provided.

The vehicle developer device 300′ includes ports and/or connectors toreceive various ECUs and peripheral devices. Adapters may be provided toensure that each ECU and peripheral device may be electrically coupledto the vehicle developer device 300′.

In the illustrated embodiment, an ECU section 350 is provided wherein aplurality of ECU slots 352, 354 are provided. The ECU slots 352, 354 mayhave different sizes for receiving different ECUs. ECUs may also beprovided within a body 303 of the vehicle developer device 300′ and/oron the underside of the vehicle developer device 300′. The ECUs that areplugged into the ECU slots 352, 354 are connected to a communicationsbus, as described above. Traces and or wiring is provided to couple theECUs and peripheral devices to the communications bus and to oneanother.

Ports or connectors are provided to receive peripheral devices (i.e.,sensors and actuators). In some instances, the peripheral devices arefull-sized versions of the sensors and/or actuators. In other instances,a subset of the plurality of the peripheral devices may be miniaturerepresentations of the actual vehicle hardware. For example, tail lightsmay be represented by small light emitting diodes (LED). A steeringwheel may be represented by a miniature steering wheel or an electronicsteering unit operable to turn the vehicle. An engine may be representedby a small electric motor. The vehicle developer device may therefore bea miniature version of the vehicle being simulated. For example, a body30 of the vehicle developer device may be a vehicle body with doors,panels, and the like. Developers may create and test software on thevehicle developer device, and even have the vehicle developer devicedrive around to test different scenarios.

The example vehicle developer device 300′ of FIG. 14 includes aplurality of sensor slots 334 that may simulate sensors, such as a seatbelt sensor, for example. A developer may press a tab into the sensorslots 334 to simulate a contact switch of a seat belt sensor, forexample. Slots 336 are empty and ready to receive a sensor, an actuator,or some other component for evaluation. The example vehicle developerdevice 300′ also includes a plurality of push buttons 346 to simulateactuation of various sensors. For example, a developer may press in onepush button to simulate the presence of a driver in the driver seat(e.g., a driver seat sensor), or a door being closed. The push buttons346 may be used to simulate any contact sensor within an actual vehicle.In some embodiments, the push buttons 346 and/or any other sensor portmay be electromechanically controlled so that the developer may program“scenes” for evaluation (e.g., doors opened/closed, passengerspresent/not present in seats, etc.). This way, the developer may savetime by not having to manually set the push buttons 346 and/or othersensor ports.

The example vehicle developer device 300′ also includes side slots 333or ports for receiving additional sensors that may be found on the sideof an actual vehicle, such as cameras, for example. Any sensor may beplugged into these side slots 333 for testing and evaluation. Uponinsertion, the sensor is coupled to the communications bus and ready tocommunicate with the ECUs.

The vehicle developer device 300′ may also include one or more speakers342 for simulating an audio system of the vehicle and/or a horn of thevehicle. Wheels 340, a motor/engine (not shown), a steering unit orsystem (not shown), and a braking unit or system (not shown) is alsoprovided so that the vehicle developer device 300′ may be remotelydriven and/or may be autonomously driven. In some embodiments, acomputing device or a remote controller may provide wireless controlsignals to simulate user inputs into an actual vehicle. Thus,acceleration, braking, and steering inputs may be provided to thevehicle developer device 300′ by a remote control or computing device.

The example vehicle developer device 300′ further includes miniaturebrake and tail lights 332, which may be configured as small LEDs, thatrepresent actual brake lights and tail lights of a full-scale vehicle.Also included are rear proximity sensors 330 that may be actualproximity sensors intended for an actual vehicle. The vehicle developerdevice 300′ may include ports and/or connectors to easily plug in andremove the proximity sensors 330 for testing.

In some embodiments, the vehicle developer device 300′ includes one ormore electronic displays 344 to display content intended for displaywithin an actual vehicle. For example, the electronic display 344 maydisplay an instrument cluster screen, or a heads up display screen. Insome embodiments, the vehicle developer device 300′ includes a video-outport for connecting to an external electronic display. In someembodiments, the one or more electronic displays 344 show a status ofone or more sensors and/or actuators. For example, the one or moreelectronic displays 344 may show a graphic indicating a door is openedwhen a door sensor is indicating that the door is opened. The one ormore electronic displays may show that status of any sensor and/oractuator.

Developers may use the vehicle developer device 300′ to test andevaluate both software code and hardware devices. Developers may deploynew software and/or hardware to the vehicle developer device, which isoperated and provides evaluation data back so that changes can be made,if necessary. As a non-limiting example, a developer of proximitysensors may have developed a new proximity sensor. Rather than testingthe new proximity sensor in an actual vehicle, which may be timeconsuming and costly, the developer may remove the old proximity sensorsfrom the vehicle developer device 300′, insert the new proximitysensors, and operate the vehicle developer device 300′ to evaluate theperformance of the proximity sensor, and to see if the new proximitysensors generate errors. Similarly, and upgraded ECU may be swapped outand tested within the vehicle developer device 300′ rather than anactual vehicle. The ability to quickly and easily change hardwarecomponents for evaluation significantly decreases the development timeto develop new hardware. A developer can test hardware right on theworkbench.

It should now be understood that embodiments of the present disclosureare directed to vehicle developer devices and systems that allow adeveloper to quickly and easily evaluate software code and/or peripheraldevices such as sensors and actuators of a vehicle without requiring anactual, full-scale vehicle. A developer computing device communicatesdirectly with a management computing device of a vehicle developerdevice to interact with the vehicle developer device and deploy softwareto the vehicle developer device.

While particular embodiments have been illustrated and described herein,it should be understood that various other changes and modifications maybe made without departing from the spirit and scope of the claimedsubject matter. Moreover, although various aspects of the claimedsubject matter have been described herein, such aspects need not beutilized in combination. It is therefore intended that the appendedclaims cover all such changes and modifications that are within thescope of the claimed subject matter.

1. A vehicle developer device comprising: a plurality of electroniccontrol units; a plurality peripheral devices communicatively coupled tothe plurality of electronic control units, wherein one or moreindividual peripheral devices of the plurality of peripheral devices isa physical representation of an actual vehicle peripheral device; and amanagement computing device comprising one or more processors and amemory device storing computer-readable instructions that, when executedby the one or more processors, causes the one or more processors to:receive one or more sets of software instructions; compile the one ormore sets of software instructions for execution by at least oneelectronic control unit of the plurality of electronic control units;receive output from one or more of: 1) at least one electronic controlunit of the plurality of electronic control units and 2) at least oneperipheral device of the plurality of peripheral devices; and provideinformation regarding the output to one or more remote computingdevices, wherein the vehicle developer device simulates operation of afull-scale simulated vehicle.
 2. The vehicle developer device of claim1, wherein the one or more sets of software instructions comprise athird party software application.
 3. The vehicle developer device ofclaim 2, wherein the information comprises evaluation data correspondingto an operation of the third party software application.
 4. The vehicledeveloper device of claim 1, further comprising an electronic displaydevice, wherein: the one or more sets of software instructions comprisevehicle user interface display instructions comprising a plurality ofscenes; and each scene of the plurality of scenes is dependent on astatus of the vehicle developer device based at least in part on theplurality of electronic control units and the plurality of peripheraldevices; and at least one electronic control unit of the plurality ofelectronic control units executes the vehicle user interface displayinstructions to cause individual scenes of the plurality of scenes to bedisplayed at least on the electronic display device.
 5. The vehicledeveloper device of claim 4, wherein at least one peripheral device ofthe plurality of peripheral devices comprises an interior light that isilluminated in response to at least one scene of the plurality ofscenes.
 6. The vehicle developer device of claim 4, wherein at least oneperipheral device of the plurality of peripheral devices comprises aspeaker that is operated in response to at least one scene of theplurality of scenes.
 7. The vehicle developer device of claim 4,wherein: the plurality of electronic control units comprises anautonomous driving module configured to cause the vehicle developerdevice to autonomously drive within an environment; one or moreelectronic control units of the plurality of electronic control unitsreceive data from one or more peripheral devices of the plurality ofperipheral devices; and one or more scenes of the plurality of scenesare displayed on the electronic display device based at least in part onthe data received from the one or more peripheral devices.
 8. A methodof developing a user interface, the method comprising: receiving, into adesign user interface, one or more design assets; receiving, from thedesign user interface, one or more manipulations of the one or moredesign assets to form a design project comprising at least one scene;providing software instructions representing the project to a vehicledeveloper device; and receiving evaluation information from the vehicledeveloper device, wherein the evaluation information is based at leastin part on execution of the software instructions by the vehicledeveloper device.
 9. The method of claim 8, further comprising receivingfrom the design user interface, an update to the project based at leastin part on the evaluation information.
 10. The method of claim 8,wherein the evaluation information comprises at least one error.
 11. Themethod of claim 8, wherein: the vehicle developer device compiles theproject into machine executable code; and the vehicle developer devicecomprises an electronic display device that displays one or more scenesbased on the machine executable code.
 12. The method of claim 8, furthercomprising simulating the project based on the software instructions ina virtual vehicle environment.
 13. The method of claim 12, wherein thesimulating includes simulating a plurality of peripheral inputs, aplurality of peripheral outputs, and at least one error message.
 14. Themethod of claim 8, wherein the vehicle developer device comprises: aplurality of electronic control units; a plurality peripheral devicescommunicatively coupled to the plurality of electronic control units,wherein one or more individual peripheral devices of the plurality ofperipheral devices is a physical representation of an actual vehicleperipheral device; and a management computing device comprising one ormore processors and a memory device storing computer-readableinstructions that, when executed by the one or more processors, causethe one or more processors to: receive the software instructions;compile the software instructions for execution by at least oneelectronic control unit of the plurality of electronic control units;receive output from one or more of: 1) at least one electronic controlunit of the plurality of electronic control units and 2) at least oneperipheral device of the plurality of peripheral devices; and providethe evaluation information, wherein: the vehicle developer devicesimulates operation of a full-scale simulated vehicle; and the vehicledeveloper device is smaller in size than the full-scale simulatedvehicle.
 15. A vehicle developer system comprising: a developercomputing device programmed to: display a design user interface forreceiving one or more design assets; receive one or more manipulationsof the one or more design assets within the design user interface forgenerating one or more manipulated design assets; and compile the one ormore manipulated design assets into a design project; a vehicledeveloper device programmed to: receive the design project from thedeveloper computing device; compile the design project into machineexecutable code; and execute the machine executable code and produce adisplay output; wherein the vehicle developer device simulates operationof a full-scale simulated vehicle; an electronic display deviceprogrammed to receive and display the display output from the vehicledeveloper device.
 16. The vehicle developer system of claim 15, whereinthe vehicle developer device comprises: a plurality of electroniccontrol units; a plurality peripheral devices communicatively coupled tothe plurality of electronic control units, wherein one or moreindividual peripheral devices of the plurality of peripheral devices isa physical representation of an actual vehicle peripheral device; and amanagement computing device comprising one or more processors and amemory device storing computer-readable instructions that, when executedby the one or more processors, causes the one or more processors to:receive the design project from the developer computing device; compilethe design project for into the machine executable code for execution byat least one electronic control unit of the plurality of electroniccontrol units; receive output from one or more of: 1) at least oneelectronic control unit of the plurality of electronic control units and2) at least one peripheral device of the plurality of peripheraldevices, wherein the display output is based at least in part on theoutput; and provide the display output to the electronic display device.17. The vehicle developer system of claim 16, wherein: the designproject comprises a plurality of scenes; each scene of the plurality ofscenes is dependent on a status of the vehicle developer device based atleast in part on the plurality of electronic control units and theplurality of peripheral devices; and at least one electronic controlunit of the plurality of electronic control units executes the machineexecutable code to cause individual scenes of the plurality of scenes tobe displayed at least on the electronic display device.
 18. The vehicledeveloper system of claim 17, wherein at least one peripheral device ofthe plurality of peripheral devices comprises an interior light that isilluminated in response to at least one scene of the plurality ofscenes.
 19. The vehicle developer system of claim 15, wherein theelectronic display device is a component of the vehicle developerdevice.
 20. The vehicle developer system of claim 15, wherein theelectronic display device is a display monitor that simulates one ormore vehicle displays for displaying the display output.